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(57) ABSTRACT 

Entertainment content complementary to a musical record- 
ing is delivered to a user's computer by means of a computer 
network link. The user employs a browser to access the 
computer network. A plug-in for the browser is able to 
control an audio CD or other device for playing the musical 
recording. A script stored on the remote computer accessed 
over the network is downloaded. The script synchronizes the 
delivery of the complementary entertainment content with 
the play of the musical recording. 
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SYSTEM FOR COLLECTING USE DATA attain integration with existing environments and programs, 

RELATED TO PLAYBACK OF RECORDINGS particularly on the Internet, while retaining the flexibility to 

adapt to the continuing evolution of standards for on-line 

CROSS-REFERENCE TO RELATED services. 

APPLICATIONS s In a first aspect of the present invention provides a means 

rr*. . j • • • , fT To * 4 i« o vt for producers and sellers of distributed media such as CDs 

n. ™ nJ 1°/ ^n, Patent T ?| I m c m * maintain and strengthen their connection to their custom- 
08/838,082 filed Apr. 15 1997, now U.S. Pat No 5,987 ers Record compani * download ^ perio dicall y update a 
525, and U.S. patent application Ser. No. 09/060,876 filed central Ubrwy of cornplem entary content for CDs the corn- 
Apr. 15, 1998, now U.S. Pat. No. 6,154,773, both incorpo- ^ p any has in the market. The software of the present invention 
rated herein by reference. operate as a plug-in to a users web browser and directs a user 
nAnirr'DriTTMn w ^ a recor ^ company's CD to a particular section of the 
BACKGROUND central library appropriate for the user's CD. 

1. Field of the Invention In another aspect of the present invention, called "CD 

This invention pertains to the field of computer 15 Watcher" data representative of the users listening habits 

networking, and more particularly to the use of network relatlve to a record company's CD is transferred to the 

protocols to provide services to users that are related to CD record company when complementary content is delivered 

ROMs, audio recordings and other distributed media. to the ^ over a network connection. 

2 Related Art Alternatively, record companies contributing and main- 

' „ . . on taining the central library have access to the listening habits 

Over the past few years on-line services have expen- » Qf ^ ^ ^ ^ ^ ^ fof 

enced explosive growth and have become a major new form com pi eme ntary content. 

of entertainment. Alongside this new entertainment, more T . „ . ,. ^ . . , . 

4 j - . - i /* , • , j- i_ ^ j In another aspect of the invention, software is provided 

traditional forms such as musical recordings nave continued .. . r . lLi 

4 , j ! ° which permits a computer program running on a remote host 

to be consumed on a massive scale. , * i j- . -u . j j- i u * j- 1 

25 to control a distributed media player such as a compact disk 

The traditional experience of the musical recording is (CD) pkyei . DV D player, or the like on a user's computer, 

listening by a small group of persons gathered together in a ( For convenience, we use the term "CD" to refer to all 

room. The music fills the room acoustically, but there is little distributed media and the term "CD player" to refer also to 

associated visual content, and there is only a limited inter- ^ distributed media players such as DVD players and 

action with the recording, consisting essentially of deciding ^ simi]ar devices.) ^ so ft wa re is designed to permit the 

which tracks to play and performing simple transformations rer note host both to initiate actions on the CD player and to 

on the recorded sound, such as setting the volume or become aware of actions which the user has initiated by 

applying an audio equalizer. This traditional experience other control meanS) such as the buttons on tne C D player's 

dates back to the early age of 78 r.p.m. musical recordings front panel ora different CD player control program. This 

almost a century ago. ^ aspect of the invention is a buildingblock for the provision 

The traditional production of a musical recording comple- of complementary entertainment for CD content when those 

ments the traditional experience of the recording. The recordings are fixed in the prevailing contemporary form, 

recording is produced in a number of recording sessions, the CD. 

subject to careful mixing and editing, and then released to j n another aspect of the invention, visual content, includ- 
the public. At that point, the recording is in a fixed form, 4Q interactive content, may be delivered over an on-line 
nowadays an audio CD, whose purpose is to record as service in such a way that it is synchronized to the delivery 
faithfully as possible the final sonic experience designed by 0 f content from a musical recording. Such visual content 
its authors, the musicians, producer, and recording engi- may, for example, be synchronized to the playing of an audio 
neers - CD or other distributed media in the user's computer. The 
Music videos have supplemented the traditional experi- 45 visual content is thematically linked to the musical 
ence of musical recordings by allowing the association of recording, for example in the manner of a music video, 
visual content with tracks of such a recording. In practice, i n a further aspect of the invention, a method is provided 
however, music videos have been broadcast, with all the for determining or assigning a substantially unique identifier 
problems of lack of user control which that implies, and they to CD or other distributed media content consisting of a 
have not contributed to interactivity or participation by the 50 number of tracks. A unique identifier is a useful complement 
consumer. On-line services offer opportunities for enriching to the delivery of supplementary content in conjunction with 
the experience associated with prerecorded material. The the playing of a CD or other distributed media in that it 
present invention is addressed to computer programs, allows the software which delivers the supplementary con- 
systems, and protocols which can fulfil this promise. tent to be sure that the CD is in fact the correct CD to which 

SUMMARY OF THE INVENTION 55 "SfiT? dLZT'fnr 2 l™!?^ 

tary content is designed, lor example, to accompany the 

It is therefore an object of this invention to provide Rosary Sonatas of Heinrich Ignaz Franz Biber, it would 

computer programs, systems, and protocols which allow presumably not function well if the CD or other distributed 

producers to deliver entertainment complementary to dis- media in the user's player were the soundtrack for the film 

tributed media recordings by means of on-line services such 60 Mary Poppins. The unique identifier also allows a CD or 

as the Internet. It is a further object of this invention to other distributed media to be used as a key to access a 

provide computer programs, systems, and protocols which premium Web area. Furthermore, the unique identifier can 

allow such complementary entertainment to be meaning- allow the user to be directed to an area of the Web corre- 

fully interactive for the consumer, such that the consumer sponding to the CD or other distributed media which is in the 

can also be a creator of the experience. 65 user's machine. 

It is a further object of the invention to achieve the In a still further aspect of the invention, the immensely 

foregoing objects by means of implementations designed to popular on-line service generally referred to as a "chat 
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room" may be enhanced by means of a link to a CD not already running, client 26 may launch it. Once the link 

recording which all persons in the room are playing. A to look-up server 40 is established, client 26 sends CD ID 31 

remote host may control distributed media players in mul- to look-up server 40. Look-up server 40 compares CD ID 31 

tiple remote locations The chat room experience as it exists against table 42. Table 42 is a look-up table linking CD IDs 

today in on-line services has a disembodied quality by 5 with some associated content and with particular addresses 

comparison with traditional face-to-face social encounters in havin S complementary content. Other information such as 

which there are identifiable surroundings. The only common umin £ and 0011(101 data > electronic coupons, advertisements 

experience to the chat users today are the words of the chat and bonus content such as video with timing and control data 

as they fly by on a computer screen, and perhaps the user ma y ^ be contained in table 42. At block 44, look-up 

fu * »\ *l • i I i • ii « server 40 sends information such as address 46 to the user 

icons C avatars ) or other visual content occupying a small 10 h ^ (o fe t q{ cd m 31 ^ informalion sent t0 

space on the screen The use of a musical recording in ^ 0f ma £ nQt ^ based Qn ^ usef d hic 

conjunction with a chat room opens up the possibility of dau and ^ demographic data 62 mi to look-up server 40. 

restoring to the experience a degree of the shared ambience At block 48 cUent 2 6 establishes a link to address 46. 

of traditional social encounters. Furthermore, shared content Address 46 may be a premium or subscription site such as 

such as a musical recording offers a focal point that allows 15 s j te 5iAin which case CD ID 31 may operate as a password, 

chatseekers to group together by means of shared interests in In oae ^ pcc[ of the prescnt inventio ^ contcnt suppliers 

a particular type of recording. 51-56 such as record companies 1-6 respectively, maintain 

a central library 50 on the web. Content suppliers may also 

BRIEF DESCRIPTION OF THE DRAWINGS include advertisers, CD retailers, and other content rights 

FIG. 1 is a network diagram of a first embodiment of the 20 |">Were. Central library 50 may be on a single server such as 

v resent invention look-up server 40 or it may be distributed. Central library So 

" . . contains the complementary content sites such as site 51A 

FIG. 2 is a flow diagram of the embodiment shown in lioked by the addresses j n ta bl c 42 such as address 46. Each 

FIG. 1. content supplier 51-56 may change the content of their site 

FIG. 3 is a block diagram of the environment in which the 2 s and add new links to additional sites as new CDs are 

present invention operates. released. As new sites are added, new CD IDs and linked 

FIG. 4 is a block diagram of complementary content addresses are added to table 42. 

according to an aspect of the present invention. At block 49A, server 58 hosting site 51A transfers 

FIG. 5 is a flowchart of the synchronization code of the ^pkmentao 'content .60 to the user'* ; computer 10 Once 

J 30 the user is linked to site 51 A, client 26 sends stored use 

demographic data 62 and CD status data 64 to look-up server 

FIG. 6 is a flowchart of the sequence of operations for 40 and or 5 g At block 66 clicnt 2 6 continues to 

connecting the present invention to a chat room. update md trans f er ^ demographic data 62 and CD status 



DESCRIPTION OF PREFERRED 



data 64 to look up server 40 and or server 58 as long as client 

PMRnnmFism 35 26 is running. Closed loop update 70 permits a content 

supplier, such as content suppliers 51-56, a real-time or near 

Referring to FIGS. 1 and 2, an embodiment of the present real-time look at which CDs are in use and relative fre- 

invention dynamically connects a user playing a CD with a quency of use of CD elements and related information, 

remote host for data exchange. At block 11, the user links to Closed loop update 70 also provides control of distributed 

a remote host and requests a download of client 26. To 40 media playing on a users computer 10. A removal or change 

receive the download the user must provide some basic of CD at block 68 would return the client to block 30A. 

information, name, email, chat name, etc. The registration In another embodiment, this invention operates on the 

information is exchanged for client 26 at block 11A. At Worldwide Web. The HTTP protocol on the web is run atop 

block 10A user computer 10 is running computer program a general connection-oriented protocol, which today is gen- 

12 such as a browser with client 26. At block 30A insertion 45 erally TCP/IP, described in Douglas E. Comer, Internet- 

of CD 30 into player 32 triggers action by client 26. Client working with TCP/IP (3d ed. 1995). However, the invention 

26 takes control of player 32 and scans CD 30. CD 31 may described here is not limited to HTTP running over any 

include time code 31 A and other encoded data 31B. Client particular kind of network software or hardware. The prin- 

26 uses the results of the CD scan to calculate a substantially ciples of the invention apply to other protocols for access to 

unique CD ID 31, block 34. Some CDs may contain an ID 50 remote information that may come to compete with or 

text file or IRC code, there is no universal standard, thus an supplant HTTP. 

ID calculation technique may yield a useful ID with any CD. Referring now to FIG. 3, a user sits at his or her computer 

This technique may create a pattern match 31F by sampling 10 and runs a computer program 12 such as a browser or 

a subset of the content of CD 30 and using the sample to other client software. The browser sends out HTTP requests 

create a substantially unique fingerprint 31F of CD 30. 5S 14 to omer computers, referred to as servers such as server 

While client 26 is calculating CD ID 31, at block 36 use 15. In requests, particular items of data, referred to as 

demographic data 62 is also collected and temporarily stored resources, which are available on servers, are referred to by 

by client 26, means of uniform resource locators (URLs), character 

Use demographic data 62 includes but is not limited to CD strings in a particular format defined in Berners-Lee et a!., 

use profiles including most used tracks, total time of use, go supra. A URL includes both an identification of the server 

most used CDs, average length of time computer 10 is and an identification of a particular item of data within the 

running, software loaded, most used software, software server. Reacting to the requests, the servers return responses 

running concurrently with client and the like. 18 to the user's browser, and the browser acts upon those 

Calculation of a CD ID 31 stimulates client 26 to direct responses, generally by displaying some sort of content to 

computer program 12 to check a local cache for CD ID 31. 65 the user. 

IF CD ID 31 is not present in the local cache client 26 links The content portion of the responses can be a "Web page," 

to look up server 40 at block 38. If computer program 12 is expressed in the hypertext markup language (HTML) such 
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as pages 20 and 22. That language allows one to express 
content consisting of text interspersed with bitmap-format 
images and links (also known as anchors and hyperlinks). 
The links are further URLs to which the browser may, at the 
user's prompting, send further requests. s 

The responses can also include more complex commands 
to be interpreted by the browser, e.g., commands which 
result in an animation as discussed below for FIG. 4. HTML 
itself does not define complex commands, but rather they are 
considered to belong to separately-defined scripting 10 
languages, of which two currently common ones are Java- 
Script and VBScript. 

In addition to extending the function of the browser by 
means of code written in a scripting language, it is also 
possible to extend the function of a browser with compiled 15 
code. Such compiled code is referred to as a "plug-in." The 
precise protocol for writing a plug-in is dependent on the 
particular browser. Plug- ins for the Microsoft browser are 
referred to by the name of Active X controls. 

20 

Plug-ins may be very complex. A plug-in which may 
advantageously be used in connection with the invention is 
Shockwave from Macromedia. It permits animations which 
are part of a server response to be downloaded and played 
to the user. Shockwave defines its own scripting language 25 
called Lingo. Lingo scripts are contained within the down- 
loadable animations which the Shockwave plug-in can play. 
The general format of a Shockwave animation is a timeline 
consisting of a series of frames, together with a number of 
visual objects which appear, perform motions, and disappear 3Q 
at particular frames within the timeline. 

To achieve more complex effects within a Shockwave 
animation, Lingo scripts may be invoked in addition to 
predefined visual objects. 

A currently preferred embodiment of the present inven- 35 
tion employs a plug-in, referred to as the command plug-in 
24, which provides to a scripting language the ability to 
command and monitor in a detailed fashion the playing of a 
CD recording. The command plug-in should provide and 
monitor, at a minimum, the following basic functions: 40 

(1) Start and stop play. 

(2) Get current track and position within the track. 

(3) Seek to a track and a position within the track. 

(4) Get and set volume. 4S 

(5) Get information regarding the CD (e.g., the number of 
tracks, their lengths, the pauses between tracks). 

(6) Get information regarding the capabilities of the CD 
drive. 

Other functions may be provided and monitored, limited 50 
only by what the underlying operating system services are 
able to accommodate. The monitored functions are included 
in use demographic data 62 which is transferred to server 40 
and or servers such as server 58. 

The command plug-in may be written in a conventional 55 
programming language such as C++. The plug-in must 
conform to the existing standards for plug-ins, such as those 
required of Microsoft Active X objects. In order to obtain the 
information and carry out the functions which the command 
plug-in makes available to the scripting language, the com- 60 
mand plug-in relies on functions which provide control and 
information regarding the playing musical recording. These 
functions will depend on the precise source of the recording. 
If, as in one embodiment of the present invention, the 
recording being played is an audio CD in the computer CD 65 
player, and if the browser is running under Microsoft Win- 
dows 3.1 or Windows 95 or Windows CE, these functions 
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would be the MCI functions, which form a part of the Win 
32 application programming interface. These functions are 
documented, for example, in Microsoft Win 32 Program- 
mer's Reference. Different functions may be provided by 
streaming audio receivers, as for example receivers which 
capture audio which is coming into the user's computer over 
a network connection in a suitable audio encoding format 
such as MPEG. 

An important point to note about the implementation of 
the command plug-in is that the operations which it carries 
out, as for example "seeks", may take times on the order of 
a second. It is undesirable for command-plug-in 24 to retain 
control of computer 10 during that interval, so it is important 
that command plug-in 24 relinquish control of computer 10 
to the browser whenever a lengthy operation is undertaken, 
and report on the results of the operation via the asynchro- 
nous event handling capability used in the common scripting 
languages. 

Given the above summary of the functions which the 
command plug-in provides, a general knowledge of how to 
write plug-ins (e.g., of how to write Active X objects), and 
a knowledge of the relevant application programming inter- 
face for controlling the play of the CD (e.g., MCI in Win32), 
a person skilled in the art could readily and without undue 
experimentation develop an actual working command plug- 
in. For this reason, further details of how the command 
plug-in is implemented are not provided here. 

The existence of a command plug-in providing the func- 
tions listed above to a scripting language is a foundation on 
which entertainment complementary to the content of a CD 
may be constructed. In particular, it is possible to devise, 
building on this foundation, a method for synchronizing the 
display of complementary content by means of the scripting 
language with the events which are occurring on the CD. 

Referring now to FIGS. 4 and 5, synchronization of the 
complementary content to the CD proceeds as follows. For 
example, complementary content 60 may be provided by 
means of animation such as Shockwave animation, includ- 
ing frames Fl-Fn and script 72. Complementary content 60 
is downloaded from server 58 and displayed for the user by 
means of a Shockwave plug-in. This downloading may take 
place before the animation is displayed, or alternatively it 
may take place as the animation is being displayed, provided 
the user's connection to the network is fast enough to 
support download at an appropriate speed. The downloading 
is a function provided by the Shockwave plug-in itself. 

As the Shockwave animation is played, script 72 such as 
a Lingo script executes each time a frame Fn finishes 
displaying. The Lingo script contains a description of the 
relationship which should exist between frames of the 
animation and segments of the CD content, identified by 
track number and by time. The Lingo script determines, by 
means of the command plug-in described above, at which 
track and time the play of the CD is. It then refers to the 
description in order to determine which frames of the 
animation correspond to that portion of the CD. If the 
current frame is not one of those frames, the Lingo script 
resets the time line of the animation so that the animation 
will begin to play at the frame which corresponds to the 
current position of the CD. This permits the visual content 
to catch up if it ever lags the CD, for example because 
downloading from the network has fallen behind, because 
the user's computer lacks the cycles to play the animation at 
full speed, or because the user has fast- forwarded the CD. 

Referring now to FIG. 4, the synchronization algorithm 
may control individual frames or groups of contiguous 
frames. Complementary content 60 includes frames F 1 -F n 
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and script 72. At block 200, a correspondence is established 
between each frame F„ or group of frames and a particular 
segment of CD 30. At the end of each frame Fn of the 
animation block 205, the position of CD 30 is determined, 
block 210. A test is done at block 215 to determine whether 
the position of CD 30 is within the segment of the recording 
that corresponds to the group of frames to which the next 
sequential frame belongs. If the position of CD 30 is within 
that segment, the playback of the animation proceeds with 
that next frame block 230. If the position of CD 30 is not 
within that segment, then at blocks 220 and 225 the playback 
of the animation is advanced to the frame corresponding to 
where the CD is. 

A further aspect of the present invention is a touring 
mode. With client 26 in touring mode, a remote device such 
as server 58 may control one or more user devices through 
delivery of complementary content 60 interspersed with 
player 26 control data to provide the one or more users with 
a guided tour of a particular distributed media such as CD 
30. 

A still further aspect of the invention is the ability, by 
making use of command plug-in 24, to provide a technique 
for establishing a unique identifier for a CD, CD ID 31, 
which is located in the user's CD player 32. The unique 
identifier may be based on the number and lengths of the 
tracks (measured in blocks, i.e., V^sths of a second), so that 
the identifier would be a concatenation of these lengths. In 
practice, however, it is desirable to have a somewhat shorter 
identifier, so the unique identifier is preferably the concat- 
enation of the track lengths expressed in a fairly coarse unit, 
such as Vith of a second. 

Appendix A contains source code, written in C, for a fuzzy 
comparison algorithm suitable for determining whether two 
audio CDs are exactly or approximately the same. The fuzzy 
comparison algorithm proceeds as follows. For each of the 
two audio CDs to be compared, one determines the lengths 
of all the tracks in the recordings in milliseconds. One then 
shifts all track lengths to the right by eight bits, in effect 
performing a truncating division by 28-256. One then goes 
through both of the recordings track by track, accumulating 40 
as one proceeds two numbers, the match total and the match 
error. These numbers are both initialized to zero at the start 
of the comparison. For each of the tracks, one increments the 
match total by the shifted length of that track in the first CD 
to be compared, and one increments the match error by the 
absolute value of the difference between the shifted lengths 
of the track in the two CDs. When one gets to the last track 
in the CD with the fewer number of tracks, one continues 
with the tracks in the other CD, incrementing both the match 
total and the match error by the shifted lengths of those 
tracks. Following these steps of going through the tracks, the 
algorithm then divides the match error by the match number, 
subtracts the resulting quotient from 1, and converts the 
difference to a percentage which is indicative of how well 
the two CDs match. 

Appendix B contains source code, written in C, for a 
comparison algorithm suitable for determining whether two 
audio CDs are exactly the same. The algorithm generates 
from the number of tracks, the track lengths, and the start 
and end times of the tracks an 8-byte value. The high order 
4 bytes are obtained by summing the start and end times of 
all tracks, expressed in milliseconds. The low order 4 bytes 
are obtained by summing the lengths of all tracks expressed 
in milliseconds, shifting the sum left ten bits, and adding the 
number of tracks. 

CD ID 31 may be employed as a database key. A site such 
as site 52 A may maintain a database of information about 
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CDs, for example information about all CDs issued by 
record company 2 can be maintained on that record com- 
pany's site. There are various alternative ways for users to 
navigate this information. For example, they could use a 
Web page containing many hyperlinks as a table of contents, 
or they could use a conventional search engine. A third way 
of searching, which is enabled by CD ID 31 of the invention, 
is for there to be a Web page which invites the user to place 
in player 32 the CD about which he or she is seeking 
information, for example CD 30. Upon detection of the 
presence of CD 30 in the drive, a script in the Web page 
computes CD ID 31 corresponding to CD 30 and sends it to 
server 58. Server 58 then displays information about the CD 
retrieved from a database on the basis of CD ID 31. This 
information may include a Web address (URL) that is related 
to the CD (e.g., that of the artists* home page), simple data 
such as the names of songs on the CD, and also comple- 
mentary entertainment, including potentially photographs 
(e.g., of the band), artwork, animations, and video clips. It 
is also possible to arrange things so that, when the user 
inserts a CD into the computer, (i) the Web browser is 
launched if not already running, (ii) the browser computes 
the CD's unique identifier and from that unique identifier 
derives a URL, and (hi) the browser does an HTTP get 
transaction on that URL. 

An alternative application of unique identifiers for musi- 
cal recordings is to employ a CD as a key for entering into 
a premium area of the Web. There are presently premium 
areas of the Web to which people are admitted by subscrip- 
tion. A simple form of admission based on the unique 
identifier is to require, before accessing a particular area of 
the Web, that the user place in his or her CD drive a 
particular CD, or a CD published by a particular company or 
containing the music of a particular band or artist. This is 
readily accomplished by means of a script which invokes the 
functions provided by the command plug in and computes a 
unique identifier. 

Another aspect of the invention is the connection of chat 
rooms with musical recordings. The goal is to provide all 
participants in a chat room with the same music at approxi- 
mately the same time. 

One conventional network protocol for chat services is 
Interney Relay Chat (IRC), described J. Oikarinen & D. 
Reed, Internet Relay Chat Protocol (Internet Request for 
Comments No. 1459, 1993), In this protocol, when one 
becomes a client of a chat server, one sends the name of a 
chat room. The chat server receives messages from all of its 
of clients and relays the messages sent in by one client to all 
the other clients connected in the same room as that client. 
The messages which a client sends are typically typed in by 
the user who is running the client, and the messages which 
a client receives are typically displayed for the user who is 
running the client to read. 

In a preferred embodiment of the invention, a chat client 
is customized by means of a plug-in, which we will call the 
chat plug-in. The chat client is started up by a browser as 
follows (see FIG. 5). The user connects by means of the 
browser to a central Web page (box 300) which, upon being 
downloaded, asks that the user insert a CD into his or her 
player (box 305). A unique identifier of the CD is computed 
and communicated back to the server by using the control 
plug-in described above under the command of a script in 
the central Web page (box 310). The server then employs the 
unique identifier to determine whether it has a cbat room 
focused on the CD (box 315). This step may be carried out 
by looking the unique identifier up in a database using 
techniques well known in the art. There exists a vast 
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literature on connecting Web pages to databases, e.g., 
December & Ginsburg, supra, chapter 21. If a chat room 
focused on the CD exists or can be created, the server 
responds with the name of that chat room, and the browser 
starts up a chat client on the user's computer as a client of 5 
that chat room (box 320). 

The chat room's name is set by the server to contain 
information about the track which the CD is playing in the 
other chat room clients' machines and the time at which the 
track started to play, as well as about the volume at which 
the CD is playing. The chat client plug-in employs that 
information to direct the control plug-in to set the CD in the 
user's computer to play in such a manner that it is approxi- 
mately synchronized to the CD which is playing in the other 
chat room clients' machines (box 320). 15 

Each user in the chat room is able to control the CD which 
is playing in his or her machine. Control actions result in the 
chat plug-in sending messages to the chat server which 
describe the control action being taken (box 325). For 
example, such messages may indicate a change in the 2Q 
position of the CD, a change in the volume, or the ejection 
of the CD to replace it with another. The chat plug-ins 
running on the other users 3 machines, upon seeing a message 
of this kind, replicate the action (as far as possible) on the 
other users' machines by using the control plug-in described 
above (box 330). 

In a further aspect of the invention, a chat room focused 
on a particular musical recording might allow for a voting 
procedure to select particular tracks. A simple voting pro- 
cedure would be for each chat plug- in to act upon a change 3Q 
message of the kind described in the preceding paragraph 
only when it sees two identical consecutive change mes- 
sages. This would mean that in order to change the track 
which is being played, it would be necessary for two users 
to change to that track. The number two may be replaced by 35 
a higher number. 

In a further aspect of the invention the messages delivered 
to the users of a chat can be driven from a text file rather than 
manual typing. This would allow a pre-recorded experience 
to be played back for a group of chat users. Such a technique 4Q 
may be used to create a pre-recorded, narrated tour of an 
audio CD. 

An important advantage of the embodiment described 
above is that it may be used with any chat server software 
which supports the minimal functionality required by Inter- 45 
net Relay Chat or by a protocol providing similar minimum 
chat service. The additional software required is located in 
the chat client plug in and in the central Web page, with its 
connection to a database of CD information. 

We claim: 

1. A system for transferring information associated with 
playback of a recording, comprising: 

a first device to reproduce a recording, to identify the 
recording from information obtained from contents of 
the recording used to play back contents of the record- 55 
ing perceived by a user and to collect use data associ- 
ated with the recording; 
a second device to store the use data; and 
a network coupled to said first and second devices to 
transfer the use data from said first device to said 60 
second device. 

2. A method of obtaining information associated with 
playback of recordings at a first device connectable to a 
second device via a network, comprising: 

collecting, at the first device, use data associated with a 65 
recording fixed in a medium possessed by a user and 
identified by information obtained from the recording 



50 



used to play back contents of the recording perceived 
by the user and not stored to identify the recording; and 
transferring the use data from the first device to the second 
device via the network. 

3. A method as recited in claim 2, wherein the use data are 
related to at least one of a portion of the recording and play 
time of the recording. 

4. A method as recited in claim 3, further comprising: 
obtaining user demographic data; and 

sending the user demographic data to the second device. 

5. A method as recited in claim 4, further comprising 
supplying complementary content for the recording to the 
first device via the network. 

6. A method as recited in claim 5, further comprising 
selecting the complementary content based on the use data 
and the user demographic data. 

7. A method as recited in claim 2, 
wherein the local device is a computer, and 

wherein said collecting includes monitoring operations 
performed by the computer while the recording is 
played. 

8. A method as recited in claim 7, 

wherein said monitoring detects software executing on the 
computer while the recording is played, and 

wherein the use data transferred to the second device 
include identification of the software executing on the 
computer while the recording is played. 

9. A method as recited in claim 7, wherein said monitoring 
detects user inputs while the recording is played. 

10. A method as recited in claim 7, wherein said moni- 
toring detects operational data transmitted over the network 
to and from the computer. 

U. A method as recited in claim 10, wherein the opera- 
tional data include at least one uniform resource locator. 

12. A method as recited in claim 11, wherein said method 
further comprises supplying complementary content for the 
recording to the first device via the network. 

13. A method as recited in claim 12, 

wherein the use data include the operational data, and 
wherein said method further comprises: 

sending user demographic data from the first device to 

the second device via the network; and 
selecting the complementary content based on the use 
data and the user demographic data. 

14. A method as recited in claim 7, 

wherein said collecting detects at least one computer 

program loaded in the computer, and 
wherein the use data transferred to the second device 

include identification of the at least one computer 

program loaded into the computer. 

15. A method as recited in claim 14, 

wherein said collecting detects frequency of use of the at 
least one computer program loaded in the computer, 
and 

wherein the use data transferred to the second device 
include the frequency of use of the at least one com- 
puter program loaded in the computer. 

16. A method as recited in claim 2, 

further comprising registering a user of the first device to 

obtain a user identifier, and 
wherein said transferring further includes transferring the 

user identifier with the use data to the second device. 
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17. A method as recited in claim 16, further comprising: 
obtaining user demographic data; and 

sending the user demographic data to the second device. 

18. A method as recited in claim 17, further comprising 
supplying complementary content for the recording to the 
first device via the network. 

19. A method as recited in claim 18, further comprising 
selecting the complementary content based on the use data 
and the user demographic data. 

20. A method as recited in claim 2, wherein the use data 
include frequency data indicating number of times the 
recording is played at the first device. 

21. A method as recited in claim 20, wherein the recording 
contains segments, and 

wherein the frequency data indicate the number of times 
the segments are played at the first device. 

22. A method of obtaining information associated with 
playback of recordings containing segments at a first device 
connectable to a second device via a network, comprising: 

identifying at least one segment of a recording, fixed in a 
medium possessed by a user, based on information 
obtained from contents of the recording stored in the 
medium for a purpose other than identifying the record- 
ing; 

collecting, at the first device, use data associated with the 
recording, the use data including segment data identi- 
fying the at least one segment played at the first device; 
and 

transferring the use data from the first device to the second 
device via the network. 

23. A method as recited in claim 22, wherein the segment 
data include a number of times the at least one segment has 
been played at the first device. 

24. A method as recited in claim 23, wherein the segment 
data include how much of the at least one segment has been 
played each time. 

25. A method as recited in claim 22, wherein the segment 
data include how much of the at least one segment has been 
played. 

26. A method as recited in claim 22, wherein the segment 
data include how often the at least one segment has been 
played. 

27. A method as recited in claim 22, wherein the medium 
is a compact disc with audio content, the segments are tracks 
on the compact disc and the segment data indicate playback 
of the tracks on the compact disc. 

28. A method as recited in claim 22, wherein the medium 
is a digital versatile disc, the segments are tracks on the 
digital versatile disc and the segment data indicate playback 
of the tracks on the digital versatile disc. 

29. A method as recited in claim 22, 

further comprising identifying the recording based on 
length of the segments to obtain a recording identifier, 
and 

wherein said transferring includes sending the recording 
identifier to the second device. 

30. A method as recited in claim 29, wherein the medium 
is a disc and the length of the segments is obtained from 
table of contents information on the disc. 

31. A method as recited in claim 2, wherein the recording 
is a digital file containing digitized audio signals. 

32. A method as recited in claim 31, wherein the digital 
file contains audio data compressed using MPEG encoding. 

33. A method as recited in claim 2, wherein the use data 
include total time of use of the recording. 

34. A method as recited in claim 33, wherein the use data 
include time of use of the first device. 
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35. A method as recited in claim 2, further comprising 
supplying complementary content for the recording to the 
first device via the network. 

36. A method as recited in claim 35, further comprising: 
s obtaining user demographic data; and 

sending the user demographic data to the second device. 

37. A method as recited in claim 36, further comprising 
selecting the complementary content based on the use data 
and the user demographic data. 

10 38. A method as recited in claim 2, further comprising 
continuing said collecting and transferring of the use data 
from the first device to the second device via the network as 
long as the recording is being played at the first device. 
39. A method as recited in claim 2, 
15 further comprising detecting a volume level at which the 
recording is being played, and 
wherein said sending includes sending data indicating the 
volume level. 
20 40. A method as recited in claim 2, 

further comprising reading a recording identifier on the 

recording, and 
wherein said transferring includes sending the recording 
identifier to the second device. 
25 41. Asystem for obtaining information based on playback 
of at least one recording at a first device connected to a 
second device via a network, comprising: 
identification means for identifying a recording based on 
information obtained from contents of the recording 
30 stored in the medium for a purpose other than identi- 
fying the recording; 
collection means for collecting use data related to at least 
one of a portion of a recording fixed in a medium 
possessed by the user, and play time of the recording; 
35 connection means for establishing a connection between 
the first and second devices; 
transmission means for sending the use data from the first 

device to the second device via the network; and 
storage means for storing the use data at the second 
device. 

42. A system as recited in claim 41, 

wherein the use data relate to a plurality of recordings, 
and 

45 wherein the use data include frequency of use of the 
recordings. 

43. A computer-readable storage storing instructions to 
control a processor to perform a process comprising: 

collecting, at a first device, use data associated with 
50 playback of a recording, fixed in a medium possessed 
by a user and identified by information obtained from 
contents of the recording used to play back contents of 
the recording perceived by the user; and 
transferring the use data from the first device to a second 
55 device connected to the first device via a network. 

44. A computer-readable storage as recited in claim 43, 
wherein said process further comprises: 

obtaining user demographic data; and 

sending the user demographic data to the second device. 
60 45. A computer-readable storage as recited in claim 44, 
wherein said process further comprises obtaining as the use 
data, information regarding playing of at least one portion of 
the recording. 

46. A computer* readable storage as recited in claim 45, 
65 wherein said process further comprises supplying comple- 
mentary content for the recording to the first device via the 
network. 
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47. A computer-readable storage as recited in claim 46, 
wherein said process further comprises selecting the 
complementary content based on the use data and the user 
demographic data. 

48. A computer-readable storage as recited in claim 43, 
wherein said process further comprises monitoring opera- 
tions performed by the first device during playback of 
the recording, and 

wherein the use data indicate the operations performed by 
the first device during playback of the recording. 

49. A computer-readable storage as recited in claim 48, 
wherein the operational data include at least one uniform 
resource locator. 

50. A computer-readable storage as recited in claim 49, 
wherein said process further comprises supplying comple- 
mentary content for the recording to the first device via the 
network. 

51. A computer-readable storage as recited in claim 50, 
wherein said process further comprises: 

sending user demographic data from the first device to the 

second device via the network; and 
selecting the complementary content based on the use 

data and the user demographic data. 

52. A computer-readable storage as recited in claim 43, 
wherein the first device is a computer, 

wherein said collecting detects at least one computer 

program loaded in the computer, and 
wherein the use data transferred to the second device 

include identification of the at least one computer 

program loaded into the computer. 

53. A computer-readable storage as recited in claim 52, 
wherein said collecting detects frequency of use of the at 

least one computer program loaded in the computer, 
and 

wherein the use data transferred to the second device 
include the frequency of use of the at least one com- 
puter program loaded in the computer. 

54. A computer-readable storage as recited in claim 43, 
wherein said process further comprises registering a user 

of the first device to obtain a user identifier, and 
wherein said transferring further includes transferring the 
user identifier with the use data to the second device. 

55. A computer-readable storage as recited in claim 54, 
wherein said process further comprises: 

obtaining user demographic data; and 

sending the user demographic data to the second device. 

56. A computer-readable storage as recited in claim 55, 
wherein said process further comprises supplying comple- 
mentary content for the recording to the first device via the 
network based on the use data and the user demographic 
data. 

57. A computer-readable storage as recited in claim 43, 
wherein the recording contains segments, 

wherein said process further comprises identifying at least 

one segment of the recording, and 
wherein the use data include segment data identifying the 

at least one segment played at the first device. 

58. A computer-readable storage as recited in claim 57, 
wherein the segment data include a number of times the at 
least one segment has been played at the first device. 

59. A computer-readable storage as recited in claim 58, 
wherein the segment data include how much of the at least 
one segment has been played each time. 

60. A computer-readable storage as recited in claim 57, 
wherein the segment data include how much of the at least 
one segment has been played. 
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61. A computer- readable storage as recited in claim 57, 
wherein the segment data include how often the at least one 
segment has been played. 

62. A system for transferring information associated with 
5 playback of a recording, comprising: 

a first device to reproduce a recording fixed in a medium 
possessed by a user, to identify the recording from 
information obtained from contents of the recording 
stored in the medium for a purpose other than identi- 
io fying the recording, and to collect use data associated 
with the recording; 
a second device to store the use data; and 
a network coupled to said first and second devices to 
transfer the use data from said first device to said 
15 second device. 

63. A system as recited in claim 62, wherein the recording 
is a compact disc with audio content stored on tracks and the 
use data indicate playback of the tracks on the compact disc. 

64. A system as recited in claim 63, 

20 wherein said first device obtains a recording identifier 
based on length of the tracks, and 
wherein said network sends the recording identifier to said 
second device. 

65. A system as recited in claim 62, wherein the recording 
25 is a digital versatile disc and the use data indicate playback 

of tracks on the digital versatile disc. 

66. A system as recited in claim 62, wherein the recording 
is a computer file containing digitized audio signals. 

67. A system as recited in claim 66, wherein the computer 
30 file contains audio data compressed using MPEG encoding. 

68. A system as recited in claim 62, wherein said network 
transfers complementary content for the recording from said 
second device to said first device. 

69. A system as recited in claim 68, 

35 wherein said first device obtains user demographic data; 
and 

wherein said network sends the user demographic data 
from said first device to said second device. 
^ o 70. A system as recited in claim 69, further comprising 
wherein said second device selects the complementary con- 
tent based on the use data and the user demographic data. 

71. A system as recited in claim 62, wherein said first and 
said second devices are not always connected via said 
network and said first device stores the use data when not 

45 

connected to said second device and transmits the use data 
to said second device after a connection is established. 

72. A system as recited in claim 62, wherein said first 
device automatically generates a recording identifier from 

5Q information included in the recording and sends the record- 
ing identifier to said second device with the use data. 

73. A system as recited in claim 72, wherein the recording 
includes at least two segments and said first device generates 
the recording identifier based on length of the segments. 

55 74. A computer-readable storage as recited in claim 43, 
wherein said process further comprises: 

automatically generating a recording identifier from infor- 
mation included in the recording; and 
sending the recording identifier with the use data from the 
60 first device to the second device. 

75. A computer-readable storage as recited in claim 74, 
wherein the recording includes at least two segments, and 
wherein said generating generates the recording identifier 
based on length of the segments. 
65 76. A computer-readable storage as recited in claim 43, 
wherein said collecting is performed regardless of 
whether the first and second devices are connected, 
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wherein said process further includes establishing a con- 
nection between the first and second devices, and 

wherein said transferring transfers all of the use data 
collected while the first and second devices were not 
connected, from the first device to the second device 
via the network after the first and second devices are 
connected. 

77. A method as recited in claim 2, wherein the recording 
is fixed in a medium possessed by a user of the first device. 

78. A method as recited in claim 2, further comprising: 

automatically generating a recording identifier from infor- 
mation included in the recording; and 

sending the recording identifier with the use data from the 
first device to the second device. 

79. A method as recited in claim 78, 

wherein the recording includes at least two segments, and 
wherein said generating generates the recording identifier 
based on length of the segments. 

80. A method as recited in claim 22, further comprising: 

automatically generating a recording identifier from the 

segment data; and 
sending the recording identifier with the use data from the 

first device to the second device. 

81. A method as recited in claim 22, 

wherein said collecting is performed regardless of 
whether the first and second devices are connected, 

wherein said process further includes establishing a con- 
nection between the first and second devices, and 

wherein said transferring transfers all of the use data 
collected while the first and second devices were not 
connected, from the first device to the second device 
via the network after the first and second devices are 
connected. 

82. A method as recited in claim 22, wherein the recording 
is fixed in a medium possessed by a user of the first device. 

83. A method as recited in claim 2, 

wherein said collecting collects the use data for a plurality 
of recordings fixed in at least one medium possessed by 
the user, and 

wherein said transferring includes providing identification 
of the user. 

84. A method as recited in claim 83, further comprising 
storing the use data at the second device to provide an 
indication of the recordings played by the user. 

85. A method as recited in claim 22, 

wherein said collecting collects the use data for a plurality 
of recordings fixed in at least one medium possessed by 
the user, and 

wherein said transferring includes providing identification 
of the user. 

86. A method as recited in claim 85, further comprising 
storing the use data at the second device to provide an 
indication of the recordings played by the user. 

87. A system as recited in claim 41, 

wherein said collecting means collects the use data for a 
plurality of recordings fixed in at least one medium 
possessed by the user, and 

wherein said sending means further sends data identifying 
the user. 

88. A system as recited in claim 87, wherein said storing 
means stores the use data at the second device to provide an 
indication of the recordings played by the user. 
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89. A computer-readable storage as recited in claim 43, 

wherein said collecting collects the use data for a plurality 
of recordings fixed in at least one medium possessed by 
the user, and 

wherein said transferring includes providing identification 
of the user. 

90. A computer- readable storage as recited in claim 89, 
further comprising storing the use data at the second device 

10 to provide an indication of the recordings played by the user. 

91. A system as recited in claim 62, 

wherein said first device collects the use data for a 
plurality of recordings fixed in at least one medium 
possessed by the user, and 
15 wherein said network further transfers data identifying the 
user. 

92. A system as recited in claim 91, wherein said second 
device stores the use data to provide an indication of the 

2Q recordings played by the user. 

93. A method of obtaining information associated with 
playback of recordings at a first device connectable to a 
second device via a network, comprising: 

collecting, at the first device, use data associated with a 
25 recording identified by information obtained from con- 
tents of the recording used to play back contents of the 
recording perceived by a user; and 
transferring the use data from the first device to the second 
device via the network. 
30 94. A method of obtaining information associated with 
playback of recordings containing segments at a first device 
connectable to a second device via a network, comprising: 
identifying at least one segment of a recording, based on 
35 information obtained from or related to the segment 
and included in the recording to enable playback of the 
segment rather than to identify the segment; 
collecting, at the first device, use data associated with the 
4o at least one segment of the recording, the use data 
including segment data identifying the at least one 
segment played at the first device; and 
transferring the use data from the first device to the second 
device via the network. 
45 95. Asystem for obtaining information based on playback 
of at least one recording at a first device connected to a 
second device via a network, comprising: 
identification means for identifying a recording based on 
50 information obtained from contents of the recording 
used to play back contents of the recording perceived 
by a user; 

collection means for collecting use data related to at least 
one of a portion of a recording fixed in a medium 
55 possessed by the user, and play time of the recording; 
connection means for establishing a connection between 

the first and second devices; 
transmission means for sending the use data from the first 
60 device to the second device via the network; and 

storage means for storing the use data at the second 
device. 

96. A computer-readable storage storing instructions to 
65 control a processor to perform a process comprising: 

collecting, at a first device, use data associated with 
playback of a recording identified by information 
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obtained from contents of the recording used to play 
back contents of the recording perceived by a user; and 
transferring the use data from the first device to a second 
device connected to the first device via a network. 

97. A system as recited in claim 1, wherein the informa- 
tion used to identify the recording was not stored for the 
purpose of indentifying the recording. 

98. A method as recited in claim 22, wherein the medium 
is a compact disc, each segment is a portion of a track on the 
compact disc determined by track number and playing time 
within the track, and the segment data indicate playback of 
the segments on the compact disc. 

99. A method as recited in claim 22, wherein the infor- 
mation used to identify the recording is stored in the medium 
prior to possession of the medium by the user. 
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100. A computer-readable storage as recited in claim 43, 
wherein the information used to identify the recording was 
not stored for the purpose of identifying the recording. 

101. A method as recited in claim 93, wherein the infor- 
mation used to identify the recording was not stored for the 
purpose of identifying the recording. 

102. A system as recited in claim 95, wherein the infor- 
! mation used to identify the recording was not stored for the 

purpose of identifying the recording. 

103. A computer-readable medium as recited in claim 96, 
wherein the information used to identify the recording was 
not stored for the purpose of identifying the recording. 

* + * + * 
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